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Adaptive Filtering Using Recurrent Neural Networks 

Precise system models are not needed for state filtering. 
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A method for adaptive (or, optionally, 
nonadaptive) Filtering has been devel- 
oped for estimating the states of complex 
process systems (e.g., chemical plants, 
factories, or manufacturing processes at 
some level of abstraction) from time se- 
ries of measurements of system inputs 
and outputs. The method is based partly 
on the fundamental principles of the 
Kalman filter and partly on the use of re- 
current neural networks. 

The standard Kalman filter involves an 
assumption of linearity of the mathemat- 
ical model used to describe a process sys- 
tem. The extended Kalman filter accom- 
modates a nonlinear process model but 
still requires linearization about the state 


estimate. Both the standard and ex- 
tended Kalman filters involve the often- 
unrealistic assumption that process and 
measurement noise are zero-mean, 
Gaussian, and white. 

In contrast, the present method does 
not involve any assumptions of linearity of 
process models or of the nature of 
process noise; on the contrary, few (if 
any) assumptions are made about process 
models, noise models, or the parameters 
of such models. In this regard, the 
method can be characterized as one of 
nonlinear, nonparametric filtering. 

The method exploits the unique ability 
of neural networks to approximate nonlin- 
ear functions. In a given case, the process 


model is limited mainly by limitations of 
the approximation ability of the neural 
networks chosen for that case. Moreover, 
despite the lack of assumptions regarding 
process noise, the method yields mini- 
mum-variance filters. In that they do not 
require statistical models of noise, the neu- 
ral-network-based state filters of this 
method are comparable to conventional 
nonlinear least-squares estimators. 

The figure schematically depicts an ex- 
ample of a process system connected to a 
neural-network state filter that is a hybrid 
of nonadaptive and adaptive parts. The 
nonadaptive part of die system is an avail- 
able system model (predictor), which 
could be a conventional mathematical 
model or a neural network. This hybrid 
implementation is suitable if the inaccu- 
racy in the system model is of a determin- 
istic nature. The output of the system 
model is corrected by use of an error 
model implemented by a neural network. 
The inputs to the error model at the 
(FtT)st sampling time are the past inputs 
u(£), the past output measurements y(t + 
1), and the past outputs of the error 
model, y e (t|t). The output of the error 
model is the output correction term y e (t + 
1|£ + 1), and the corrected system-model 
output yc(t+ 1|£ + 1) is die sum of the cor- 
rection term plus the predictor output. 
Connection weights and biases in the 
error-model and state-filter neural net- 
works are updated in response to the out- 
put residual term e(t+ 1) = y(£ + 1) -y, c(t+ 
1|£ + 1); the updates are generated in an 
on-line adaptation scheme implemented 
by algorithms that seek to minimize quad- 
ratic error measures by the gradient-de- 
scent method. 
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Hybrid Adaptive Neural Network State Filter 


A Hybrid Nonadaptive/Adaptive Neural-Network State Filter generates accurate estimates of the 
state of a process system, even if the system model is inaccurate. 
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